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~ The MAILING DATE of this communication appears on tho cover sheet with the correspondence address 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- tf NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )S Responsive to communication(s) filed on 21 November 2005 , 
2b)\3 This action is FINAL. 2b)M This action is non-final. 

3) n Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under £xpa/te Quay/e, 1935 CD. 11, 453 O.G. 213, 

Disposition of Claims 

4) M Claim(s) 1-13 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) 0 Claim(s) is/are allowed. 

6) 13 Claim(s)M3 is/are rejected. 
?)□ Claim(s) is/are objected to. 

8) 0 Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) n The specification is objected to by the Examiner. 

10)0 The drawing(s) filed on is/are: 3)0 accepted or b)n objected to by the Examiner. 

Applicant may not request that any objection to the drawlng(s) be held in abeyance. See 37 CFR 1 .85(a). 

Replacement drawing sheet(s) including the connection is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
1 !)□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or fomn PTO-152. 

Priority under 35 U.S.C. § 119 

12)0 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 
a)n All b)n Some * 0)0 None of: 

1 .□ Certified copies of the priority documents have been received. 

2. n Certified copies of the priority documents have been received in Application No. . 

3. n Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the'attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 

1. This action is responsive to communications: RCE filed 1 1/21/20.05 to the original 
application filed 03/06/2000. 

2. Claims 1-13 are currently pending in this application. Claim 1 has been amended. Claim 
1 is independent claim. 

3. The previous Office Action inadvertently indicated claim 1 as a system claim in the 35 
use § 101 rejection, and this Action has provided a proper 35 USC § 101 rejection. 

Request Continuation for Examination 

4. A request for continued examination under 37 CFR LI 14, including the fee set forth in 
37 CFR 1.17(e), was filed in this application after final rejection. Since this application is 
eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 
1.1 7(e) has been timely paid, the finality of the previous Office action has been 
withdrav^n pursuant to 37 CFR 1.1 14. Applicant's submission filed on 1 1/21/2005 has 
been entered. 

Claim Rejections - 35 USC §101 

5. 35 U.S.C. 101 reads as follows: 



Whoever invents or discovers any new and, useful process, machine, manufacture, or composition of matter, or 
any new and useful improvement thereof may obtain a patent therefor, subject to the conditions and 
requirements of this title. 
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6. The language of claims 1-13 raises a question as to whether the claim is directed merely 
to an abstract idea that is not tied to a technological art, environment or machine which 
would result in a practical application producing a useful, concrete, and tangible result to 
form the basis of statutory subject matter under 35 U.S.C. 101. 



7. Claims 1-13 are rejected xmder 35 U.S.C. 101 because the claimed invention because the 
claims do not appear to require the use of computer hardware to implement the claimed 
invention. 

For example, independent claim 1 recites: 

A method of ordering multimedia content, comprising the steps of: 
segmenting the multimedia content to extract objects; 
extracting and associating features of the objects to produce content 
entities, wherein the content entities are recursive data structures comprising 
features, relations, directed acyclic graphs and containment sets; 

coding the content entities to produce directed acyclic graphs of the 
content entities, each directed acyclic graph representing a particular 
interpretation of the multimedia content; measuring attributes of each content 
entity; and 

assigning the measured attributes to each corresponding content entity in 
the directed acyclic graphs to rank order the multimedia contenf\ 

The claimed steps do not define a machine or computer implemented process, and 
appear to be comprised of software alone without claiming associated computer hardware 
required for execution, and is not supported by either a specific and substantial asserted 
utility (i.e., transformation of data) or a well estabHshed utility (i.e;, a practical 
application). Therefore, the claimed invention is directed to non- statutory. subject mater. 
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Claim Rejections - 35 USC § 103 



8. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in section J 02 of this title, if 
the differences between the subject matter sought to be patented and the prior art are such that the subject matter as a whole would 
have been obvious at the time the invention was made to a person having ordinary skill in the art to which said subject matter 
pertains. Patentability shall not be negatived by the manner in which the invention was made. 

This application currently names joint inventors. In considering patentability of the claims under 35 U.S.C. 103(a). the examiner 
presumes that the' subject matter of the various claims was commonly owned at the time any inventions covered therein were made 
absent any evidence to the contrary. Applicant is advised of the obligation under 37 CFR 1.56 to point out the inventor and invention 
dates of each claim that was not commonly owned at the time a later invention was made in order for the examiner to consider the 
applicability of 35 U.S.C. 1 03(c) and potential 35 U.S.C. 102(e). (f) or (g) prior art under 35 US.C. 103(a). 

9. Claims 1-13 are rejected under 35 U.S.C. 103(a) as being unpatentable over Yeo et al. 
(US 5,821,945, issued 10/1998), as cited in the Applicant's IDS. 



As to claim 1: 



Yeo teaches a method for ordering multimedia content (see the Abstract), 
comprising the steps of: 

(i) segmenting the multimedia content to extract objects (col. 2, lines 35-47); 

(ii) extracting (col. 4, lines 62-col5, line 2) and associating features of the 
objects to produce content entities (col3, line 21-col4, line 57), wherein 
the content entities are recursive data structures comprising features 
(coL9, lines 42-56), relations (col.5, line 64-col.6, line 11), directed 
acyclic graphs (col:4, lines 36-58); 
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(iii) coding the content entities to produce directed acyclic graphs of the 
content entities, each directed acyclic graph representing a particular 
interpretation of the multimedia content (col. 5, lines 3-5 2)\ 

(iv) measuring attributes of each content entity (coL6, lines 24-31); and 

(v) assigning the measured attributes to each corresponding content entity in 
the directed acycHc graphs (coL6Jine 51-col8, line 7) to rank order the 
multimedia content (col 10, lines 39-32 and see figs. 4-5). 

b. Yeo does not specifically teach the use of containment sets. Yeo, however, 
discloses "interrelated shots". 

c. It would have been obvious to one of ordinary skill in the art at the time the • 
invention was made to have applied Yeo's teaching to include ''containment sets'' 
because it would have provided the capability for identifying both visual and 
temporal relationships to allow the user to recognize the underlying story 
structure and navigate to the desired point in the video. 

As to claim 2: 

Yeo teaches the measured attributes include intensity attributes (col. 7, line 35-col8, line 
8). 

As to claim 3: 

Yeo teaches the measure attributes include direction attributes (col.7, lines 13-19). 
As to claim 4: 

Yeo teaches the measured attributes include spatial attributes (col. 9, line 42-col.lO, line 
7). 
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As to claim 5: 

Yeo teaches the measured attributes include temporal attributes (coL9, line 42-collO, 
line 7), 

As to claim 6: 

Yeo teaches the measured attributes are arranged in an increasing rank order (col. 5, line 
65'Col.6, line 11 and col 10, lines 32). 
As to claim 7: 

Yeo teaches the measured attributes are arranged in an decreasing rank order (col. 5, line 
65 -col. 6, line 11 and col. 10, lines 32). 
As to claim 8: 

Yeo teaches traversing the multimedia content according to the directed acyclic graph 
(col. 3, line 24- col4, line 10) and the measured attributes assigned to the content entities 
(col.6, line 24-col.8, line 7). 
As to claim 9: 

Yeo teaches summarizing the multimedia content according to the directed acyclic graph 
(coL9, lines 19-42) and the measured attributes assigned to the content entities (col6, 
line 24-col.8, line 7). 
As to claim 10: 

Yeo teaches the multimedia content is a three dimensional video sequence (coL 7, lines 
12-19), 

As to claim 11: 
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Yeo teaches nodes of the directed acychc graphs represent the content entities and edges 
represent breaks in the segmentation, and the measured attributes are associated with the 
corresponding edges (col. 5, lines 37-52). 
As to claim 13: 

Yeo teaches a summary of the multimedia is a selected permutation of the content 
entities according to the associated ranks (col9, lines 19-42). 
As to claim 12: 

Yeo teaches at least one secondary content entity is associated with a particular content 
entity, and wherein the secondary content entity is selected during the traversing (coL2, 
lines 35-48 and col. 6, lines 1-21). 



10. Applicants' arguments filed 1 1/21/2005 have been fully considered but are moot in view 
of the new ground(s) rejection. 

Conclusion 

1 1 . The prior art made of record and not relied upon is considered pertinent to applicant's 



Response to Arguments 



disclosure. 



Arman et al 



U.S. Patent No. 5,521,841 



issued: May 28, 1996 



Kim 



U.S. Patent No. 5,673,369 



issued: Sep. 30, 1997 



Yeo et al. 



U.S. Patent No. 5,708,767 



issued: Jan. 13, 1998 



Ratakonda 



U.S. Patent No. 5,956,026 



issued: Sep. 21, 1999 
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Friedman et al., ''Image Segmentation in video sequences: A probabilistic 
approach''. Computer Science Division, 1997, pp. 1-13. 

Divakaran et al., ''Report on Validation Experiment on Ordered Relation 
Graphs'\ December 1999, pp. 1-14. 

Yeo et al., "Time-constrained Clustering for Segmentation of Video into Story 
Units'\ IEEE Proceedings of ICPR'96, pp. 375-380, 1996. 
12. Any inquiry concerning this communication or earlier communications from the 

examiner should be directed to Maikhanh Nguyen whose telephone number is (571) 272- 
4093. The examiner can normally be reached on Monday - Friday from 9:00am - 5:30 
pm. If attempts to reach the examiner by telephone are unsuccessfiil, the examiner's 
supervisor, Heather Hemdon can be reached at (571) 272-4136. 
The fax phone number for the organization where this application or proceeding is 
assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published 
applications may be obtained from either Private PAIR or Public PAIR. Status 
information for unpublished applications is available through Private PAIR only. For 
more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business 
Center (EBC) at 866-217-9197 (toll-free). 



MN 




HEATHER R.HERNDON 
SUPERVISORY PATENT EXAMrNER 
TECHNOLOGY CENTER 2 : 00 



